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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

• Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

• If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 9/20/05 . 
2b)\3 This action is FINAL. 2b)l3 This action is non-final. 

3) n Since this application is in condition for allowance except for fomnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Clainfis 

4) M Claim(s) 1-S7 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) M Claim(s) 68-70 is/are allowed. 

6) 13 Claim(s) 1-22.26-44,59-61 and 63-67 is/are rejected. 

7) 13 Claim(s) 23-25.45-58 and 62 is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) ^ The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are: a)^ accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the con-ection is required if the drawing(s) Is objected to. See 37 CFR 1.121(d). 

1 1) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 1 1 9 

12) 0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 
a)n All b)n Some * c)[J None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) □ Notice of References Cited (PTO-892) 

2) □ Notice of Draflsperson's Patent Drawing Review (PTO-948) 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 

Paper No(s)/Mail Date . 



4) CH Interview Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) □ Notice of Informal Patent Application (PTO-1 52) 

6) □ Other: . 
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DETAILED ACTION 



Specification 



1 . Applicant is reminded of the proper language and format for an abstract of the disclosure. 

The abstract should be in narrative form and generally limited to a single paragraph on a 
separate sheet within the range of 50 to 1 50 words. It is important that the abstract not exceed 
150 words in length since the space provided for the abstract on the computer tape used by the 
printer is Umited. The form and legal phraseology often used in patent claims, such as "means" 
and "said," should be avoided. The abstract should describe the disclosure sufficiently to assist 
readers in deciding whether there is a need for consulting the full patent text for details. 

The language should be clear and concise and should not repeat information given 
in the title. It should avoid using phrases which can be impHed, such as, "The disclosure 
concerns/' "The disclosure defined bv this invention/' "The disclosure describes/' etc> 

2, The title of the invention is not descriptive. A new title is required that is clearly 
indicative of the invention to which the claims are directed. 



Allowable Subject Matter 



3. Claims 23-25,45-58, and 62 are objected to as being dependent upon a rejected base 
claim, but would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. 



4. 



Claims 68-70 are allowable over the prior art of record 
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5. The following is a statement of reasons for the indication of allowable subject matter: 

As per claims 45-58,62,68-70 the recited limitations pertaining to the structure of 
the apparatus in storing, allocating, and decision making with respect to storing and accessing 
behavioral codes is not explicitly taught by the prior art of record. 



Claim Rejections - 35 USC § 102 



6. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international appUcation filed under the treaty defined in section 35 1(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 



7. Claims 1-22,26-44,59-61,63-67 are rejected under 35 U.S.C. 102(e) as being anticipated 
bv Hatlelid et al (6404438V 

As per claims 1,28, Hatlelid et al (6404438) teaches a method for interpreting 
nonverbal communicative behavior of an individual (as interpreting utterances to identify 
behavior (col. 1 lines 55-61; col. 9 lines 55-65) comprising: 

"observing. . . .individual" as recording a behavior (col, 1 lines 58-62); 

"acquiring access explanation" as accessing stored behavioral rules (col. 2 

liens 25-39); 

"assigning.... behavior" as assignment to behaviors (Fig. 3b); 
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"comparing codes" as comparing observed contexts to existing stored 

associations between previous utterances and behaviors (col. 2 lines 64-67); 

"retrieving the explanation, . . .code" as suing the behavioral information to match 
the code (col. 7 hnes 20-37). 

As per claims 2,28, Hatlelid et al f 640443 8) teaches storing the observed behavior 
(col 12 hnes 10-18). 

As per claims 3,28, Hatlelid et al (6404438) teaches storing in segments (as 
segmented files - fig. 4b, fig. 8). 

As per claims 4,19, Hatlelid et al (6404438) teaches accessing and interpreting 
behavior codes (as automatic searching of behavior codes, that are based on previous 
information, to determine interpret the new utterance/input ~ col. 3 hnes 10-30). 

As per claims 5,7, Hatlelid et al (6404438) teaches compressed information into 
fi-ames (Fig. 8), 



As per claim 6, Hatlelid et al (6404438) teaches string of audio and image fi*ames 
(fig. 14a, and 14b) 
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As per claim 8, Hatlelid et al (6404438) teaches recognizing behavior units, 
assigning a unit code, and combining the two (as mapping of mood and personality into 
behavioral movement - fig. 3b) 

As per claims 9,17, Hatlelid et al (6404438) teaches gesture and sound units (Fig. 

4a). 

As per claim 10, Hatlelid et al (6404438) teaches synchronized gesture and sound 
units to form behavior code (fig. 5). 

As per claim 1 1 , Hatlelid et al (6404438) teaches chronological order of the 
behavior units (as keeping track of playback and duration ID - fig. 14b) 

As per claim 12. Hatlelid et al (6404438) teaches adding/modifying the behavior 
code if it sxxrpasses a threshold (col, 26 line 64 - col. 27 Une 9). 

As per claim 13, Hatlelid et al (6404438) teaches storage in a database (col 8 

lines 40-50). 



As per claim 14, Hatlelid et al (6404438) teaches user ID to edit the association 
(col. 7 liens 10-18). 
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As per claims 15,21, Hatlelid et al (6404438) teaches weighting the characteristics 
into subsets (col. 8 lines 55-65). 

As per claim 16, Hatlelid et al (6404438) teaches searching, matching, and 
prioritizing the behavior codes (col. 8 lines 55-65). 

As per claim 18, Hatlelid et al (6404438) teaches the recited claim limitations 
common to claim 1 as noted above in the rejection of claim 1. Furthermore, as per claim 18, 
Hatlelid et al (6404438) teaches noting and identifying a plurality of behaviors, generating a 
collection of behaviors, and noting the associated codes with the succession of behaviors (col. 25 
line 55 - col. 26 Une 67). 

As per claim 22, Hatlelid et al (6404438) teaches generating context and images 
based on the certain part of the conversation (col 26 Unes 25-45). 

As per claim 26, and 27, Hatlelid et al (6404438) teaches a plurality of moods and 
emotions for the user to transmit, along with gestures (col. 24 line 12 - col. 60). 



Claims 29-44,65-67 are directed toward an apparatus which implement the 
method claimed in claims 1-28, and are similar in scope and content and are rejected under 
similar rationale. 
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As per claims 59-67 Hatlelid et al (6404438) teaches the system to be perforaied 
over server based systems (col. 5 Unes 1-15), incorporating modules into each user's appUcation 
(col 5 lines 6-10), based on internet protocols (col. 5 lines 15-25; col. 5 lines 40-51); using more 
than one remote location (col. 5 hnes 54-60); sending different information based on the 
user(coL 9 lines 46 -65; col. 10 lines 38-49;col. 12 lines 32-65). 

Response to Arguments 

8. Applicant's arguments filed 3/7/05 have been fully considered but they are not 
persuasive. As per appHcants general allegation that Hatlelid et al does not teach explanations 
associated with behavior codes, examiner disagrees and points to Fig. 3b and the recited passages 
to column 2 as noted above in the rejection. Applicant's arguments do not comply with 37 
CFR 1 . 1 1 1(c) because they do not clearly point out the patentable novelty which he or she thinks 
the claims present in view of the state of the art disclosed by the references cited or the 
objections made. Further, they do not show how the amendments avoid such references or 
objections. 

Conclusion 



9. Any inquiry concerning this communication or earlier communications fi'om the 
examiner should be directed to Michael Opsasnick, telephone number (571)272-7623, 
who is available Tuesday-Thursday, 9am-4pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mr. Wayne Young, can be reached at (571)272-7582. The facsimile phone 
number for this group is (571)272-7629. 

Any inquiry of a general natxxre or relating to the status of this application or 
proceeding should be directed to the Group 2600 receptionist whose telephone number is 
(571) 272-2600, the 2600 Customer Sendee telephone number is (571)272-2600. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) systena. Status information for 
published applications may be obtained from either Private PAIR or PubUc PAIR. Status 
information for unpublished appKcations is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 



mno 



10/11/2005 




Michael M Opsasnick 
Examine/ 
Art Unit 2655 



